What is claimed is: 



1. A method for controlling a web farm having a plurality of websites and servers, the method 
comprising: 

categorizing customer requests received from said websites into a plurality of categories, 
said categories comprising a shareable customer requests and unshareable customer requests; 

routing said shareable customer requests such that any of said servers may process 
shareable customer requests received from different said websites; and 

routing said unshareable customer requests from specific said websites only to specific 
servers to which said specific websites have been assigned. 

2. The method of claim 1 further comprising a Goal procedure, said Goal procedure comprising 
determining, for each said customer request, an optimal server from among said servers to which 
each said customer request is to be assigned so as to minimize an average customer response 
time at any given moment, given said assignment of said websites to said servers and a current 
customer request load. 

3. The method of claim 2 wherein said Goal procedure is effected by minimizing the function 
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is minimized subject to the constraints 
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where Mis the number of websites, AT is the number of servers, i?j is the expected response time as a 
function of customer arrival rate at server j, x tJ is a decision variable representing the hypothetical 



number of shareable requests for website i that might be handled by server/, y t j is a decision 
variable representing the hypothetical number of unshareable requests for website i that might be 
handled by server /, L } is the maximum acceptable load for server /, c\ is the current number of 
shareable customer requests from website /, d\ is the current number of unshareable requests from 
5 website z, ay is an index indicating if shareable requests from website i may be routed to server/, 
and 6i j is an index indicating if unshareable requests from website i may be routed to server/. 

4. The method of claim 3 further comprising 

creating and maintaining a directed graph, said directed graph comprising a dummy node 
10 and a plurality of server nodes, each said server node corresponding to one of said servers; 
designating one of said sever nodes a winning node for which the expression 



is minimal; and 

choosing a shortest directed path from said dummy node to said winning node. 

15 

j* 5. The method of claim 1 further comprising a Static procedure, said Static procedure comprising 
IS assigning specific said websites to specific said servers for the purposes of processing unsharable 
W customer requests. 

m 

20 6. The method of claim 5 wherein said Static procedure assigns said websites to specific servers 
based upon forecasted demand for shareable and unsharable customer requests from each said 
website. 

7. The method of claim 2 further comprising a Dynamic procedure, said Dynamic procedure 
25 comprising: 

examining the next customer request; 

invoking said Goal procedure in order to determine which server is the optimal server to 
currently process said next customer request; and 

dispatching said next customer request to said optimal server. 

30 
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8. The method of claim 7 further comprising: 

receiving said customer requests into a queue; and 
wherein said Dynamic procedure further comprises: 

monitoring said customer requests in said queue; 

monitoring customer requests currently being processed by said servers; 

defining, for each / h server, a function R. (z) by setting 
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defining, for each / h server, a revised acceptable load limit L } by setting 

Lj=L j -Y J (c iJ ^d iJ );md 
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invoking said Goal procedure to utilize said R. (z) function and revised acceptable 
load limit L. to minimize the function 
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subject to the constraints: 
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where x ij is a decision variable representing the hypothetical number of shareable requests in the 
queue for website i that might be handled by server j, y u is a decision variable representing the 
hypothetical number of unshareable requests for website i that might be handled by server j, c i is 
the current number of shareable customer requests in the queue from website i, d t is the current 
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number of unshareable requests in the queue from website i, c, is the current number of shareable 
customer requests from website i currently being processed in one of the servers, and d i is the 
current number of unshareable requests from website i currently being processed in one of the 
servers. 

5 

9. A program storage device readable by machine, tangibly embodying a program of instructions 
executable by the machine to perform method steps for controlling a web farm having a plurality 
of websites and servers, said method steps comprising: 

categorizing customer requests received from said websites into a plurality of categories, 
10 said categories comprising a shareable customer requests and unshareable customer requests; 

routing said shareable customer requests such that any of said servers may process 
O shareable customer requests received from different said websites; and 

jB routing said unshareable customer requests from specific said websites only to specific 

^ servers to which said specific websites have been assigned. 

m 

T 10. The apparatus of claim 9 further comprising a Goal procedure, said Goal procedure 

P comprising determining, for each said customer request, an optimal server from among said 

Hi servers to which each said customer request is to be assigned so as to minimize an average 

% customer response time at any given moment, given said assignment of said websites to said 

Wb servers and a current customer request load. 

11. The apparatus of claim 10 wherein said Goal procedure is effected by minimizing the 
function 

25 is minimized subj ect to the constraints 



YOR9-2001-0666 US1 (8728-553) 



- 33 - 



Xy=Oiffly=0, 

N 

w , and 

>V = 0 if = 

where M is the number of websites, N is the number of servers, i?j is the expected response time as a 
5 function of customer arrival rate at server j, x t j is a decision variable representing the hypothetical 
number of shareable requests for website i that might be handled by server j 9 y t j is a decision 
variable representing the hypothetical number of unshareable requests for website i that might be 
handled by server j 9 Zj is the maximum acceptable load for server j, c\ is the current number of 
shareable customer requests from website i 9 d\ is the current number of unshareable requests from 
1J& website i 9 ay is an index indicating if shareable requests from website i may be routed to server j 9 
and 6y is an index indicating if unshareable requests from website z may be routed to server y. 

s r!i 

SI 

ipj 12. The apparatus of claim 1 1 further comprising 

H b creating and maintaining a directed graph, said directed graph comprising a dummy node 

pi 

15 and a plurality of server nodes, each said server node corresponding to one of said servers; 
Tt : designating one of said sever nodes a winning node for which the expression 

is minimal; and 

choosing a shortest directed path from said dummy node to said winning node. 

20 

13. The apparatus of claim 9 further comprising a Static procedure, said Static procedure 
comprising assigning specific said websites to specific said servers. 

14. The apparatus of claim 13 wherein said Static procedure assigns said websites to specific 
25 servers based upon forecasted demand for shareable and unsharable customer requests from each 

said website. 
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15. The apparatus of claim 10 further comprising a Dynamic procedure, said Dynamic procedure 
comprising: 

examining the next customer request; 

invoking said Goal procedure in order to determine which server is the optimal server to 
currently process said next customer request; and 

dispatching said next customer request to said optimal server. 

16. The apparatus of claim 15 further comprising: 

receiving said customer requests into a queue; and 
wherein said Dynamic procedure further comprises: 

monitoring said customer requests in said queue; 

monitoring customer requests currently being processed by said servers; 

defining, for each f h server, a function Rj (z) by setting 




defining, for each / h server, a revised acceptable load limit L } by setting 
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invoking said Goal procedure to utilize said R. (z) function and revised acceptable 
load limit L j to minimize the function 




subject to the constraints: 




N 



= 0 if a u =0, 



YOR9-2001-0666 US1 (8728-553) 



-- 35 -- 



N 

y,,=Oif^,.=0, 

where x i . is a decision variable representing the hypothetical number of shareable requests in the 
queue for website i that might be handled by server j\ y t J is a decision variable representing the 
hypothetical number of unshareable requests for website i that might be handled by server j 9 c. is 
the current number of shareable customer requests in the queue from website i 9 d t is the current 
number of unshareable requests in the queue from website i 9 c ( is the current number of shareable 
customer requests from website i currently being processed in one of the servers, and d t is the 
current number of unshareable requests from website i currently being processed in one of the 
servers. 

17. A web farm, comprising: 

means for receiving customer requests from customer; 

means for processing said customer requests to produce responses; 

means for transmitting said responses to said customers; 

means for categorizing said customer requests into shareable customer requests and 
unshareable customer requests; 

a network dispatcher comprising means for executing a Goal procedure, a Static 
procedure, and a Dynamic procedure; 

said Goal procedure comprising determining, for each said customer request, an optimal 
server from among said servers to which each said customer request is to be assigned so as to 
minimize an average customer response time at any given moment, given said assignment of said 
websites to said servers and a current customer request load, wherein said shareable customer 
requests may be assigned to any said server and wherein said unshareable customer requests may 
only be assigned to specific servers depending on which said website said unshareable customer 
request originated; 

said Static procedure comprising assigning specific said websites to specific said servers; 

and 
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said Dynamic procedure comprising: 

examining the next customer request; 

invoking said Goal procedure in order to determine which server is the optimal 
server to currently process said next customer request; and 
5 dispatching said next customer request to said optimal server. 
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